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Abstract 

This paper considers a multi-user single-relay wireless network, where the relay gets paid for 
helping the users forward signals, and the users pay to receive the relay service. We study the relay 
power allocation and pricing problems, and model the interaction between the users and the relay as 
a two-level Stackelberg game. In this game, the relay, modeled as the service provider and the leader 
of the game, sets the relay price to maximize its revenue; while the users are modeled as customers 
and the followers who buy power from the relay for higher transmission rates. We use a bargaining 
game to model the negotiation among users to achieve a fair allocation of the relay power. Based on 
the proposed fair relay power allocation rule, the optimal relay power price that maximizes the relay 
revenue is derived analytically. Simulation shows that the proposed power allocation scheme achieves 
higher network sum-rate and relay revenue than the even power allocation. Furthermore, compared with 
the sum-rate-optimal solution, simulation shows that the proposed scheme achieves better fairness with 
comparable network sum-rate for a wide range of network scenarios. The proposed pricing and power 
allocation solutions are also shown to be consistent with the laws of supply and demand. 

Index terms: Multi-user relay network, power allocation, pricing, Stackelberg game, Kailai- 
Smorodinsky bargaining solution (KSBS). 

I. Introduction 

Cooperative communication has been shown to be a promising concept for future wireless 
networks (e.g., JT), [|2l). The basic idea is to have multiple nodes in the network help each 
other's transmission to achieve diversity. Numerous cooperative relaying strategies aiming at 
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optimizing the global network performance have been proposed. Two widely used ones are 
amplify-and-forward (AF) and decode-and-forward (DF). For AF, the relays simply forward 
amplified versions of the signals they receive without decoding. For DF, the relays decode their 
received signals and transmit the re-encoded signals [3]. While pioneering efforts in cooperative 
networks focus on single-user networks (e.g., JU-JU), research on multi-user networks, in which 
multiple transmissions of different users can be supported, are important to meet the demands of 
future communication systems. One such model is the multi-user single-relay network (e.g., ifTOll - 
lfT6lO . Capacity bounds of the network are investigated in ifTOl . ifTTfl. and interference cancellation 
schemes are proposed in |[T2ll . |[T3~1 . In lfl4l and lfT51 . network decoding is applied to combat 
interference among users in multi-user single-relay networks. In ||T6ll, the resource allocation 
problem, including both the subcarrier allocation and the relay power allocation, in a multi-user 
single-relay network is studied to maximize the sum-rate. 

In the aforementioned papers, nodes in a network are assumed to be altruistic and willing to 
cooperate to optimize the overall network performance. In many practical applications, however, 
nodes are selfish and aim to optimize their own benefits or quality-of-service. On the other hand, 
due to limited resources available, multiple selfish users in the network have conflicts in resource 
allocation. It is important to find solutions that achieve both high overall network performance 
and fairness among users. To model and analyze these behaviors, game theory is often used [fTTl . 

Research in cooperative network designs using game theory become increasingly popular in 
recent years. Many papers have appeared in literature, e.g., |[T8l - ll25l . |[T8l considers the uplink 
of a network with multiple users and single base station, in which users can form coalitions 
and share resources to form a virtual multi-antenna system to improve performance. A merge- 
and-split algorithm is proposed to construct coalitions among users to maximize utilities, which 
are defined as the transmission rates. In |fT9l and EOt a two-user network where each user 
can also work as a relay for the other is studied. By employing a two-user bargaining game, 
fair bandwidth allocation |fT9l and power allocation ||20l are found from the Nash bargaining 
solution. In [21 J, the relay power allocation problem in the downlink of a multi-user multi-relay 
cellular network is studied. Non-cooperative game theory is used to model the competition for 
relay power among users. An iterative scheme is proposed to ensure all users reach the Nash 
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equilibrium point. 

None of the aforementioned works consider the cooperation stimulation problem. In a relay 
network, one possible solution to user cooperation stimulation is the payment-based scheme, 
where the relays get paid if they forward users' messages and users pay for the relay service. 
Here, relays and users aim to maximize their own payoffs instead of the overall network 
performance. In Il22ll - [|25l , the pricing mechanism is used to encourage the relays to help forward 
packets for the users. For multi-user ad hoc networks, compensation frameworks are proposed 
in [|22| and E3l . in which a network node sets price and receives revenue if it cooperatively 
helps others' transmissions. In [24], for a single-user multi-relay network, the relay selection 
and relay power control are investigated using a two-level Stackelberg game. In this game, the 
relays compete to provide service to the user to gain revenue. 11251 studies the user power control 
and relay pricing problems in a multi-user single-relay network. In the game theoretic model, 
the relay sets the price to maximize its revenue, while a non-cooperative game is used to model 
the user behavior, in which each user adjusts its transmit power to selfishly maximize its own 
utility. A distributed iterative scheme is proposed to achieve the unique Nash equilibrium point. 

In this paper, we consider a multi-user single-relay network and use game theory to model and 
analyze the user and relay behavior. Amplify-and-forward is adopted due to its simplicity and low 
computational load. Pricing mechanism is used where the relay gets paid for signal forwarding 
and users pay for the relay service. We model the interaction between the relay and the users as a 
two-level Stackelberg game, in which the relay is the leader and sets the unit power price for the 
relay service, and users are the followers where each user decides how much power to purchase 
from the relay. Different from 11251 . we consider the relay power allocation among users, instead 
of the user power control; and also we model the relay power competition among users as a 
cooperative bargaining game. For the relay power allocation, the Kalai-Smorodinsky bargaining 
solution (KSBS) is used for fairness. The power allocation problem is transformed into a convex 
optimization problem. With the KSBS-based relay power allocation, We analytically find the 
optimal relay price that maximizes the relay revenue. From our simulations, compared with 
the sum-rate-optimal power allocation, the proposed KSBS-based power allocation is fairer and 
achieves close-to-optimal sum-rate for a wide range of network scenarios. Compared with the 
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even power allocation, the proposed KSBS-based power allocation archives higher relay revenue 
and network sum-rate. It is also shown via simulations that the proposed relay pricing and power 
allocation solutions are consistent with the laws of supply and demand. 

The rest of this paper is organized as follows. Section [TT] gives a brief background review on 
game theory. Section ITTll describes the multi-user single-relay cooperative network model and the 
Stackelberg game and bargaining game models for the relay pricing and relay power allocation 
problems. In Section [TV] we analyze the relay power pricing and power allocation problems. 
The optimal relay price is solved analytically, while the relay power allocation is transformed 
into a convex optimization problem. Section |V] discusses the properties of the proposed solutions 
and their possible implementation. Simulation results are shown in Section [VI] Conclusions are 
drawn in Section IVIII 

II. Review of Game Theory 

In this section, we provide a brief review of game theory and introduce the basic concepts 
and results that will be used in this paper. 

Game theory mainly analyzes behavior in strategic situations, or games, in which players 
influence each other's decision and performance [|28l . A game consists of three parts: a set of 
players, a set of actions of the players, and a set of utilities that represent the players' relative 
satisfaction of the outcome of the game. Equilibrium is the strategy outcome of a game that is 
the best response of each user given the decision of others. The most famous equilibrium is the 
Nash equilibrium, in which no player can increase its utility by unilaterally changing its own 
strategy, and the corresponding strategy set and utilities constitute a Nash equilibrium. 

A. Stackelberg Game 

In a Stackelberg game, one player acts as a leader who takes action first, and the other players 
are followers who observe the leader's action and act accordingly. The subgame perfect Nash 
equilibrium of the Stackelberg game can be found using the backward induction method. It 
first studies the followers' game: for each possible action of the leader, it finds the optimal 
followers' response that maximizes the followers' payoff. Then given the optimal followers' 
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response strategy, it studies the leader's action and chooses the one that maximizes the leader's 
utility. The chosen strategy set is the Stackelberg equilibrium ||28l . 

B. Bargaining Game and Kailai-Smorodinsky Bargaining Solution (KSBS) 

A bargaining game models the bargaining interactions of players. In a bargaining problem, 
there are N players with utilities ui, u 2 , ■■■u^. A utility vector u = (ui u 2 ■■■ u^) is 
called feasible if it is possible to find a strategy set that gives the 2th player utility Ui for all 
i — 1, ■ • • ,N. Let S denote the set of all feasible utility vectors. The disagreement point, denoted 
as u = («i o u 2j o ■ ■ ■ un :0 ), is the vector of the minimal utility that each player expects if the 
players do not reach an agreement and play non-cooperatively. It is the guaranteed utility for the 
players in the bargaining game. The ideal point u 1 = (u{ u\ . . . u T N ) (the superscript T stands 
for ideal) is the vector of the maximum achievable utilities of the players in S. We thus have 
u l > Ui,o- Note that for players with u\ = u i)0 , cooperation does not increase their utilities and 
they will not enter the game. For the rest of the players, u{ > Ui j0 and they will participate in 
the bargaining process. 

Given S, the disagreement point u , and the ideal point u 1 , players negotiate with each other to 
select one feasible solution u and the corresponding strategy set that all players agree. Depending 
on how players define fairness, they may select different solutions. One popular solution for the 
bargaining game is the KSBS [|29ll , which is the solution to the optimization problem 

max A; s.t. — \ — = k (1) 

u\ - u ifi 

for all participating players with u\ > u i:0 . 

KSBS is an equilibrium point that guarantees fairness in the sense of equal penalty, which can 
be deducted from the constraint in ©. In (OQ), (u\ — and (uj — u ij0 ) are Player i's maximum 
and actual net utility gains, respectively. Taking logarithm on both sides of the constraint in ©, 
we have 

log (ul - u ii0 ) - log (ui - Wi >0 ) = - log k. (2) 

As log A; is a constant independent of the players, the constraint in forces all players partic- 
ipating in the bargaining game to suffer the same quality penalty in the logarithmic scale, and 
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thus ensures fairness in this sense. It is worth mentioning that KSBS is neither individual utility 
optimal nor global optimal in general. It is an equilibrium point that balances the proposed utility 
measure and fairness among users. 

III. Game Models for Relay Power Allocation and Pricing 

In this section, we explain the network model, elaborate the relay power pricing and relay 
power allocation problems, and propose the game theoretical models for the problems using a 
Stackelberg game and a bargaining game. 

A. Network Model 

Consider a wireless network with N users communicating with their destinations with the 
help of one relay as shown in Figure 1. Denote the channel gain from User i to Destination i 



f. 



Relay 



, . , , v-\ 3 t/vv1 Destination 1 

User 1 V/yy ' / x N 

• h/ / \ \9i ' 

• / / hi \ \ • 

U ser i Y//J 7 \~~vv7 Destination i 

• f?f \9n - 

' ' \ ' 

User N 1 1 ^ N ^f/^X Destination 



Fig. 1. Multi-user single-relay network. 



(direct link) as hi, the channel gain from User i to the relay as and the channel gain from the 
relay to Destination i as ^. The relay and destination are assumed to have global and perfect 
channel state information (CSI) /i, • • ■ , /n,9i, • • • ,9n through training and feedback. No CSI 
is required at the users. User i uses transmit power Qi and the maximum transmit power of the 
relay is P. 

Frequency division multiple access (FDMA) is used, so transmissions of different users are 
orthogonal and interference-free. Without loss of generality, we elaborate the transmission of 



User z's message on Channel i. We use the popular half-duplex two-step AF relaying protocol. 
Let Si be the information symbol of User i. It is normalized as E(|sj| 2 ) = 1, where E stands 
for the average. In the first step, User i transmits yfQlsi. The signals received by the relay and 
Destination i are 

ViR = VQiSifi + n iR and y iD = y/QisJii + n w , (3) 

respectively, where nm and nm are the additive noises at the relay and the destination in the 
first step, respectively. In the second step, the relay amplifies its received signal and forwards it 
to Destination i. Denote the power the relay uses to help User i as Pj. Since the relay has perfect 
CSI, coherent power coefficient is used for better performance ll26ll . Il27ll . The signal received 
at Destination i can be shown to be 



where tird is the additive noise at the destination in the second step. All noises are assumed to 
be i.i.d. additive circularly symmetric complex Gaussian with zero-mean and unit-variance. 

After maximum-ratio combining of both the direct path and the relay path, the effective 
received signal-to-noise-ratio (SNR) of User z's transmission can be shown to be 
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sNRj = „, z\ ;vr,i9 , , +Qi\H - ( 5 ) 



If User z's transmission is not helped by the relay and only the direct transmission is active, the 
received SNR of User z's transmission becomes 

SNRjD = Qi\hi\ 2 . (6) 

B. Game Theoretical Model for Relay Pricing and Relay Power Allocation 

In this paper, we focus on the relay power allocation among users and the relay power pricing. 
In early relay network designs, many research focused on relay power allocation that optimizes 
the global network performance. In these models, the relay has no gain and selflessly helps the 
users using its own power; and the users are also selfless, who care about the global network 
performance instead of their own benefits. In many practical applications, however, the relay 



needs incentives for cooperation. Also, there is a natural conflict among users, who want to 
obtain help from the relay to maximize their individual benefits. With no payment for the relay 
power, each user wants as much power as possible, which leads to undesirable situations, e.g., 
the total power demand from users exceeds the relay power budget. This motivates the use of 
game theory to model the selfish behavior of the users and the relay. Our goal is to find a fair 
power allocation among the users and the optimal relay pricing strategy. We use the Stackelberg 
game to model the interaction between the users and the relay, and the bargaining game to model 
the relay power allocation among the users, which, as explained in Section HH is a natural fit. 

We consider the relay as the leader of the Stackelberg game who sets the price of its power 
in helping the users. The key point of the relay game is for the relay to set the price to gain the 
maximum revenue. The relay revenue, denoted as ur, is the total payment from the users. We 
use a simple pricing model by assuming that the relay revenue is linear in the amount of power 
it sells, i.e., ur = J2f=i ^Pi> where A is the normalized unit price of the relay power and Pi is 
the power the relay uses to help User i. 

We consider the users as followers of the Stackelberg game that react in a rational way 
given the unit price of the relay power. The bargaining game is used to model the cooperative 
interaction among users. That is, we assume that users make agreements to cooperatively share 
the relay power. A key point of formulating the users as selfish players in a bargaining game is 
to design the utility function, which should reflect both the quality-of-service and the payment- 
for-service of users. Its physical meaning can be the benefits received by the users. In this paper, 
we seek to design an appropriate utility function that is not only physically meaningful, but also 
mathematically attractive to ensure tractability and convergence. 

We define the utility of User i as 

A QiPi\fi9i I , n ii |2 \ r> ■ i at rn\ 

which, for a given network scenario, is a function of P i5 the power the relay uses to help User 
i. The first two terms of CD) correspond to the effective received SNR of User i given in §5$ 
and represent the quality-of-service of the user. It is directly related to the performance of the 
communication, e.g., the achievable rate. The last term APj represents the user's normalized cost 
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in purchasing the relay service. If User % does not buy any power from the relay and uses the 
direct transmission only, i.e., Pj = 0, its utility is the minimum utility that User % expects. Thus 

u ifi = Qi\hi\ 2 . (8) 

In the following section, we analyze the above Stackelberg game and bargaining game models 
to find the optimal relay power pricing and a fair power allocation among the users. 

IV. Relay Power Allocation and Pricing Solutions 

In this section, we solve the power allocation and pricing problems jointly using the backward 
induction method ll28~l . That is, we first solve the user game, i.e., the relay power allocation among 
the users for a given price of the relay power, then solve the relay game, i.e., the optimal price 
of the relay power, based on the derived user bargaining strategy. The user game and the relay 
game are formulated and analyzed in the following two subsections, respectively. 

A. Relay Power Allocation Based on KSBS 

The user game is to find the relay power allocation among the users for a given unit power 
price A. We use the bargaining game in cooperative game theory to find a fair power allocation. 
Specifically, we look for the KSBS of the bargaining game, the background of which is provided 
in Section III-B1 

We first calculate User i's ideal utility u\ of a given A. To maximize its utility, User i's goal 

is 

maxiij s.t. Ui > u ii0 , < p < P. (9) 

Pi 

The first constraint in © ensures that User i gets no less utility than itj )0 , which is its utility 
when it receives no help from the relay, i.e., Pj = 0. The second constraint ensures that the power 
demand of User i does not exceed the total power budget P of the relay. Given a relay power 
price, this optimization problem can be solved analytically and the result is given in Lemma CD 
Lemma 1: Define 
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Given the unit relay power price A, the ideal power demand of User i that maximizes its utility 
Ui in © is 

' if A > bj 



if A<M*& + l" 



The ideal utility of User i is 

Ui,o if A > b h 

u>lW = \ Qi\mi-yfi/k) 2 + Ui, if h > A>^(^ + l)~ 2 . (12) 

k mf J)-i biP+1 - AP + Ui, if A < 6* (off^ + l y 



Proof: From ©, we have 
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^biPi + l] 3 



•9P v^l/il 2 / ' ^ 

Thus faf < 0, which means that is a concave function of Pj. 

When A > 6 i5 |f < for all P > as [{Qi\fi\ 2 Y x biPi + l] 2 > 1. So Uj is a non-increasing 



function of P t and its maximum is reached at P/(A) = 0. When \<h (q^js + 1 j , §j£ > 
for all p < P. So itj is a non-decreasing function of P, and P/(A) = P in this case. When 
6» > A > 6j (oTffp + 1) , ^ reaches its maximum when |f = 0, i.e., P = ^j££(-^= - -±=). 
This proves the ideal power solution in (fTTI) . Using this solution and the equalities © and ([8]), 
we can obtain the ideal utility for User i in (fT2l) . ■ 

From Lemma [H we see that P/(A) is independent of User i's direct link /ij. Intuitively, this 
is because the contribution of the direct link to User z's receive SNR and utility is fixed and 
keeps unchanged for any amount of relay power that User i obtains. 

Lemma [TJ also shows that when the price is too high, Case 1 in (TTTT) . User i will not buy 
any relay service. When the price is too low, Case 3 in (fTTj) . User % wants to purchase all relay 
power to maximize its utility. For the price range shown in Case 2 in (TTTT) . User i asks for part 
of the relay power that gives the ideal balance between its SNR and its payment to maximize its 
utility. The ideal power demand of User i depends not only on the relay power price, but also 
on its power constraint Qi and the quality of its local channels fa and g im The 6, defined in (flOl) . 
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whose value depends on User z's condition only, is an important parameter. As shown in (fTTT) . it 
not only determines whether a relay asks for the relay service but also affects how much power 
a user asks for ideally. We can see bi as a quality measure for User i to some extent. For any 
two users, User i and User j, assume that bi > bj. We can see that if User i is not allocated any 
relay power, which happens when bi < A, User j will not be allocated any relay power either 
because its bj is smaller. Also, for a given price A, increasing the Qi and \fi\ 2 of User i, which 
increases bi, results in higher or the same relay power demand from User i, which is shown in 
the following lemma. 

Lemma 2: Given a relay power price A, -P/(A) is a non-decreasing function of Qi and \ fi\ 2 . 
Proof: From CCD, we get, when bi > A > ^ (q^p + 1 

p j {x) = QMl_ 
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For other two price ranges, when A > bi P/(A) = 0, and when A < bi {^ q^.^ + lj > ^VC\) 
P. So, in all price ranges, 



P/(A) = max 



\9< 
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max and min are non-decreasing functions. For a given A, Qi \^\z +1 |\/ a[i+i/ 9 (q 2 |/-| 2 )] ~ l} i s 
also a non-decreasing function of Qi and \fi\ 2 - So we conclude that -P/(A) is a non-decreasing 
function of Qi and \fi\ 2 . ■ 
To find the KSBS of the user bargaining game, without loss of generality, we assume that the 
users are sorted in the descending order of their bi values, that is 

h>b 2 >--->b N . (13) 

With the given price A, for users satisfying bi < A, as shown in Lemma [H their ideal power 
demand is so they do not buy any power from the relay, thus do not enter the game. 

Let L be the number of users satisfying bi > A. That is, with the ordering in (fT3l . assume 
that bi > A > b L+1 . The first L users will participate in the bargaining game and purchase the 
relay service. Given A, to find the KSBS-based power allocation of the L users is equivalent to 
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solving the following optimization problem ||29l : 

bjPj \p L 

maxfc s.t. mm^E i = k , £P 4 <P, < P, < W ( ± - ± ), (14) 



1=1 



where u[ and w^o, given in (|T2|) and ([8]) respectively, are the ideal and minimal utilities of User 
i. The second constraint in (fl4l) is due to the total power constraint of the relay, and the last 
constraint is to ensure the feasibility of the solution and is derived from rewriting itj > it i;0 - 

In the proof of Lemma [H we have shown that U{ is a concave function of Pj. Also, «j = u i 
at Pj = and P, = Qi|/i| 2 (1/A — 1/fej), and it, reaches its maximum u((X) at Pj = P/(A). 
An example of Wj as a function of Pj is given in Figure [2l It can be shown from the utility 
definition in ([7]) that for each u G (ui >0 ,uj(X)), there are two possible choices of Pj in the 
range (0, Qi\fi\ 2 (1/A — 1/bi)) that satisfy «j(Pj) = it: one in the range (0, Pj 7 (A)] and the other 
in the range [P/(A), Qi\fi\ 2 (1/A — Thus we can shrink the feasible region of Pj from 

(0, Qi\fi\ 2 (1/A — 1/bi)) to either one of the smaller regions. We choose the first region for two 




Fig. 2. Concavity of the utility function. 



reasons. First, for the same Uj value, this choice results in a smaller Pj than choosing the second 
region, and the users prefer to buy less power to gain the same utility. Second, smaller power 
consumption for each user saves relay power, so more users can be helped. Thus, (fT4l) becomes 

max A; s.t. WE*Z^EE± 1 = k V Pj < P, < P* < P/(A). (15) 

To solve this optimization problem, we prove the following lemma. 
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Lemma 3: The relay power allocation problem in (fT5l ) is equivalent to the following max-min 
problem: 



bjPj ^p, ^ L 



max mm 



(Q l \M 2 )- 1 b t P i +l 



Pi i | U\-U ifl 



s.t. yP t <P, 0<P i <P/(A). (16) 



5*3 XPt 



Proof: First we use the notation ipJPi) = (0 ' IJ ' |2) r -^ ±l . To prove this lemma, it is 

sufficient to show that the power allocation solution in (fTBl) . denoted as (PJ*, ■ • • , P£), satisfies 
-0i(Pi ) = • • ■ = ip L (Pl). We prove this by contradiction. Without loss of generality, suppose 
that MPi) < MP2) < mm{^ 3 (P 3 *), • • • , M^)}- Thus, max Pi mim^*) = MP*)- Since 
^i(Pi), ^2^2) are increasing and continuous functions of P\,P2 in the feasible region given 
in ( TT6b . there exists a small enough positive e such that Pj" + e, P 2 * — e are still in the feasible 
region and 

MPi) < MP* + e) < ^ 2 (P 2 * - e) < ^ 2 (P 2 *). 

The new power allocation (P* + e, P 2 * — e, P 3 *, • • • , P£) satisfies all power constraints in ([TBI) . Its 
max-min value is ^i(P*+e) which is larger than the max-min value of the solution (P x *, ■ ■ • , P£). 
This contradicts the assumption that (P*, ■ ■ • , P£) is optimal, thus completes the proof. ■ 

(fT6l) is a convex optimization problem and can be solved efficiently using standard convex 
optimization techniques 11301 . We call the solution of <|T6b the KSBS-based power allocation. 
Recall that in ([TBI , only the L users whose bi's are larger than the relay price A participate in 
the game. The remaining N — L users request no relay power. 

In the game theoretical model in (fT6l) . the power constraint at the relay is taken into consid- 
eration. For any relay price A, ([TBI ) will result in a feasible power allocation among users, i.e., 
the total power demanded by the users does not exceed the relay power constraint. Without the 
game theoretical model, if, for example, for a given price, the users request their ideal relay 
powers to maximize their individual utilities, it may happen that the total power demand of 
the users exceeds the relay power constraint, and the relay cannot make a satisfactory power 
allocation. With the proposed KSBS-based relay power allocation, when the sum of the ideal 
power demands of all users does not exceed the relay power constraint, the users will be allocated 
their ideal powers, in which case, k in (fT5T ) reaches its maximum 1; when the sum of the ideal 
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power demands of all users exceeds the relay power constraint, the proposed KSBS-based power 
allocation will allocate all relay power to the users fairly. This is shown in the following lemma. 



Lemma 4: For a fixed A, let the ideal power allocation of User i be P/(A), which is given 
in CEB; and let the KSBS-based power allocation be if 1 ' (A) (K stands for KSBS). When 



Eti PfW < P> w e hav e if' (A) = P/(A); when £f=i P/(A) > P, we have Eti PfW = P- 

Proof: Again, we use the notation ijidPi) — {Qilfil } 7 biPi+1 . With the new feasible region 

of Pi in (fT6l) . ^(Pj)'s are increasing functions and reach their maximum 1 when Pj = P/(A). 
Thus k G [0, 1] and achieves the maximum k = 1 if and only if ^ ( A ) ^ P ' that is ' when 
users can reach their ideal utility with a feasible relay power. In this case, P/^(A) = P/(A). 

users can reach their ideal utilities and thus k < 1. From the 
equivalent form (fT5l) . actually no user can reach its ideal utility. That is, P t K (\) < P/(A). 
Suppose that £)f =1 Pf(A) < P. Define 

•■L r>K, 



e = min 



P El= L lPl {X \ A 7 (A) - Pf (A), • ■ ■ , P£(A) - Pf (A) 



e is a positive number. Now consider the power allocation P(A) = P/ £ '(A) + e. First, this new 
power allocation satisfies all power constraints due to its construction. Also, as ^'s are increasing 
functions, the new power allocation results in a higher minimum value, that is minj ^j(p(A)) > 
mm i 'ipi(P t K (X)), which contradicts the assumption that P,^(X) is optimal. This completes the 
proof. ■ 

B. Optimal Relay Power Price 

Now we investigate the relay pricing problem. The price of the relay power is crucial to the 
relay revenue and the relay power allocation among the users. If the relay sets the price too 
high, no user will buy any power, and the relay revenue will be zero. If the relay sets the price 
too low, all users will ask for as much power as possible; and even though all relay power can 
be sold, the relay revenue will not be maximized. 

With the unit price of the relay power A, from Section III, and by using the KSBS-based relay 
power allocation in Section IV. A, the revenue of the relay is Yli=i ^P^W* where P^(A) is 
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the relay power allocated to User i based on the KSBS for the given price A. The relay pricing 
problem can be formulated as: 

N 

max^Ai^(A). (17) 

i=l 

Note that the relay power constraint J2f=i — P * s always guaranteed by the KSBS-based 

power allocation, thus needs not to appear explicitly in the relay revenue maximization. 

To solve the relay pricing problem, we first prove the following lemma. 

Lemma 5: The optimal price is inside the interval [bib, b\), where bi b satisfies the following 
equation: 



N 

<P(b lb ) ± 



and 



b,P 



6,6 > max { bt [ + 1 ) ) (19) 



QU 



Proof: First we can see that 4>(bi b ) monotonically decreases from oo to as b[ b increases 
from to b±. Thus, the equation (fT8l has a unique positive solution inside (0, 6i). 
Then we prove (TT9l) by contradiction. Assume that bi b < 6i f + l) ■ Thus, 



6i V Vkb V 6i 

2 



which conflicts ([TBI . So 6 ifc > 6i ^ Q^-p + 1 J ■ Similarly, we can show that bi b > 6j ^g-j^p 
for z = 2, ■ • • , N. Thus <fT9~l) is proved. 

Now we show that the optimal price is no less than 6,&. Using the result in (fT9l and from 
([TTI) . when the relay power price is bi b , i.e., A = 6,6, we have 

TV 

Y^P t I (bi b ) = <P(b lb ) = P. (20) 

i=l 

Also from ([TTI) . -P/(A) is a continuous and non-increasing function of A. So J^iLi^iW * s a 
continuous and non-increasing function of A. Inside the price range [0, i.e., A < bi b , we have 
E£=i p I( X ) > p based on ©• with the KSBS-based power allocation, according to Lemma HI 
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all power of the relay will be allocated to the users , i.e., J2i=i Pi K W = P- The relay revenue 
maximization when the price is with [0, bib] becomes: 

L 

max A^if(A) = ^P, (21) 

0<\<b w * — ' 
i=l 

which is reached at A = b^. So the optimal price in the range [0, bib] is b^, which shows that 
the optimal price is no less than b^. 

To prove the upper bound on the relay price, note that when A > b\, from (fTTI) . -P/(A) = 
for all i, i.e., no user will buy any power from the relay and the relay revenue will be 0. So any 
price in the range [bi, +oo) is not optimal for the relay revenue, and the optimal price must be 
in the range [bib,bi). ■ 

The value of b^ can be obtained by solving the equation in (fT8l) . This is a generalized 
waterfilling problem 11321 , where 1/y/X is the water-level, l/y/h is the ground level of User 
i, and Qi\fi\ 2 / Vh arQ me weights that can be visually interpreted as the width of each patch. In 
this paper, we can find the value of bib analytically. Notice that (f>(bib) is a decreasing function 
of bi b and foj's are in non-increasing order. We can first find the M such that 0(&m) < P and 
<P(b M+ i) > P. Thus, b lb E [b M , b M +i}. Within this interval, <P(b lb ) = J^fLi 9j jf (^k ~ 7%) = 
(E£i 9 ^)^S- (££i ^F) • Thus, from flfo) = P, we have 



hb 



E^r) (p+t 9 ^ 1 ) ■ 02) 



,i=l V°i / \ i=i 

In what follows, we solve the optimal relay power price analytically. First, several notation 
are introduced. Recall the ordering of the users based on their bi values in (fT3l and M is the 
index such that bu > hb > bu+i- That is, the fej's of the first M users are no less than bib, 
while the 6/s of the remaining users are no larger than b^. We have shown in Lemma [5] that 
only the price range [bib, b\) needs to be considered for the optimal price. Define 7; = bi for 
% = 1, • • • , M and 7 A/+1 = b lb . Further define r\ = [72, 71) and Ti = [y i+1 , 7J for z =, 2 • • • , M. 
We thus can have divided the price range [bib, b\) into the following M intervals: 

[kb, h) = [bib, b M ] U [b M , b M -i] U • • ■ U [63, 62] U [6 2 , 61) 

4r M u iw • • ■ u r 2 u ri. (23) 
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Inside the price range [bib, h), because Yli=i * s a non-increasing function of A and ([T8"T ), 

we have J2iLi ^IW — P- Thus, P^{X) = -P/(A) from LemmaH] We can thus rewrite the price 
optimization problem in (fTTT ) into 

i 

max max XP- (A) . (24) 

i=l,2,-Af Aer, ^— ' J v ' 

In (l24l) . we have decomposed the optimization problem into M subproblems, where the ith 
subproblem is to find the optimal price within the range Tj where User 1 to % purchase non-zero 
power from the relay: 

i 

Sub-problem i : max V AP/ (A) . (25) 

The following proposition is proved to solve the sub-problem. 
Proposition 1: For % — 1, 2, • • • , M, define 

-i = I 



The solution to (1231) is 



A,- = 



7i+i if Q < 7 i+ i, 

7i if Cj > 7i, (27) 
cj if 7i + i < Q < 7i. 

Proo/- When A G r is for 1 < j < i, from (HJJ), User j will ask for Qjjf- (tx ~ 757) units 
of power, and User (i + 1) to User M will ask for zero relay power. Subproblem (1251) can be 
rewritten as 



max { A Q±f?_ ( _J_ \_ \ I _ maxo!)Rj(A), (28) 



where <^(A) 4 f £\ =1 - (E j=i %^-) A. In <J28>, <^(A) is the relay revenue 

given the price A G IV It can be shown through straightforward calculation that d(f) Rji {X)/dX = 
when A = q, defined in Proposition [TJ and d < 0, when A G IV Therefore, if q > 7$, 

0i?,i(A) reaches its maximum at 7^ if q < 7^+1, it reaches its maximum at 7; + i; and if 7 i+1 < 
Ci < 7i, it reaches its maximum at q. ■ 
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With the subproblems solved, we are ready to find the optimal relay power price. The result 
is given in the following theorem. 

Theorem 1: The optimal relay power price, denoted as A*, is 




where Aj is defined in Proposition [TJ 

Proof: This is a natural result of Proposition [TJ and (1241) . ■ 
With Theorem [Tj we can find the optimal price for the relay power by solving the M 
subproblems in (124)) analytically using Proposition [Tj then find the optimal price among the M 
sub-problem solutions that results in the maximum relay revenue. This is written as Algorithm [TJ 
We can see that, after ordering (whose average complexity is N log N), its complexity is linear 
in the number of users in the network. 



Algorithm 1 Optimal relay power price. 

i: Calculate 6,'s using (1101) . Order the iV users such that b\ > 62 ^ ■ ■ * ^ ^iv- 

2: Find M then b lh using ([221 

3: Initialize %: ji — bi for i — 1, ■ ■ • , M and 7a/+i = b^. 

4: Calculate c/s for i — 1, • ■ ■ , M using (T26l) . 

5: For 2 = 1, • • • , M, find A* using (1271) . 

6: Find the optimal price A* using ( [29l) . 



Previously, we have shown that 6/ is an important factor for the ideal relay power. Here we 
can see that it is also important for the optimal relay price. We prove the following lemma, 
which further reflects the importance of b^ 

Lemma 6: If b\ < Ab^, the optimal price for the relay is bib. 

Proof: First recall that b x > ■ ■ ■ > b M ~i > b M > b lb . When 61 < Ab lb , for % = 1, - ■ ■ , M 
and j = 1, • • • , i, we have bj <b\ < A^ M +i < ^li+i- Therefore, 

Qj\f£ , Qj\f£ „ Qi\fi\ 2 ^Q 3 \f 3 ?^l 

V 4 7i+i V% V^i & J 
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and 



for z = 1, • • • , M. From Proposition 1, within the range r, where i = 1, • • • , M, the optimal 
price is 7 i+1 , the lower bound of IY So the optimal price in the range [7m+1j 7i) is 7m+i> which 
is b lb . U 
Lemma [6] says that when the difference between b\ and bib is small, that is, the conditions 
of the users are not too separate apart, the relay should set its price to be low so all users can 
gain some benefits. On the contrary, when some users have a much higher b{ than others, the 
price will be higher than b^ and those users with lower fej's may not purchase the relay service 
because the price is too high compared to the SNR gain they may receive. 

V. Discussion 

In this section, we discuss possible implementation of the proposed relay power allocation and 
pricing solutions, properties of the power allocation solution, and applications of the proposed 
solutions to some special network scenarios. 

The first to discuss is the implementation of the proposed relay power allocation and power 
pricing solutions. In practical network applications, to use the proposed scheme, the relay, which 
is the service provider and has perfect and global channel knowledge, first finds the optimal price 
of the relay power using Algorithm \T\ With this optimal price, the relay then finds the KSBS- 
based solution for the relay power allocation problem given in (fT6l) . With this implementation, 
we actually assume that the relay is trustworthy. All users believe that the relay will not change 
the parameter values (e.g., the CSI); and the relay uses the above procedure to set the price 
and determine the KSBS-based power allocation, and follows the results to help all users in 
their transmission. For the relay to know the channel gains from the users to itself, training and 
channel estimation should be performed at the relay. For the relay to know the channel gains 
from itself to the destinations, feedback from the destinations to the relay are required. The 
proposed algorithm is a centralized one instead of distributed. 

Now we discuss properties of the KSBS-based power allocation. When the relay sets its price 
to be the optimal, from the analysis in Section |IV-B[ all users will be allocated their ideal relay 
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powers, -P/(A), and the individual utilities of the users are maximized. This is the ideal case and 
requires the relay to have perfect CSI. However, in reality, CSI at the relay is subject to error and 
delay, in which case, the relay may set a price different to the optimal one. Sometimes, the relay 
may want to set its price different to the optimal one due to other reasons such as marketing 
considerations. Our bargaining game model and KSBS-based power allocation is robust to the 
relay price fluctuation in the sense that a "fair" relay power allocation among the users can still 
be made. Specifically, if the relay power price is set to be higher than or equal to bib, defined 
in (fl"8l) . with the KSBS-based power allocation, each user gets its ideal power demand; if the 
relay power price is set to be lower than b[ b , no user can get its ideal relay power but the relay 
power will be fairly allocated to the users such that the utility losses of the users are the same 
in the logarithmic scale; and all relay power will allocated. 

Finally, we discuss the application of the proposed solution to two special network scenarios. 
One network application is the multi-user, single-relay, and single-destination network, also 
addressed as multi-access relay network (MARN) in some papers lfT0ll - lfT6ll . The proposed 
scheme can be directly applied to MARNs by setting g\ — ■ ■ ■ — in the network formulation. 
From Lemma [2l -P/(A) is a non-decreasing functions of Qi and /j. Thus, with the relay to 
destination channel the same for all users, users with better user-relay channels or higher transmit 
powers will be allocated more relay power. Another popular network scenario is the multi-user 
single-relay network with no direct links. Our solutions again can be applied straightforwardly 
as the solutions are independent of the direct link. 

VI. Simulation Results 

In this section, we show the simulated performance of the proposed relay power allocation 
and pricing solutions, and compare them with the sum-rate-optimal power allocation and the 
even power allocation. Sum-rate-optimal power allocation solution is the relay power allocation 
among the users that maximizes the network sum-rate. For the even power allocation, the relay 
allocates 1/N of its total power to each of the N user, and each user decides how much power 
to buy from the relay to maximize its utility. That is, the relay power allocated to User i is 
min{P/(A), P/N}. Two channel models are considered: the Rayleigh flat-fading channel and 
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Fig. 3. Three-user relay network with Rayleigh fading channels and different relay power constraints. 



the static channel with path-loss only. 

A. Network with Rayleigh Flat-Fading Channels 

In the first numerical experiment, the channels are modeled as i.i.d. Rayleigh flat-fading, i.e., 
fi,hi, and g« are generated as i.i.d. random variables following the distribution CA/"(0, 1). We 
consider a network with three users. The transmit powers of the users are set to be 10 dB. The 
simulation results follow the same trend for other values of user powers. 

We first investigate the network performance when the relay power ranges from 10 dB to 40 
dB. This corresponds to the scenario where the total user demand is fixed while the relay power 
supply increases. We set the relay power price to be the optimal according to Theorem [T] Figure 
|3] shows the optimal relay power price, the relay power actually sold, and the maximum relay 
revenue under different relay power constraints. We can see that when the relay has more power 
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to sell, the optimal relay power price is lower, more relay power is sold, and the relay receives 
more revenue. This complies with one of the laws of supply and demand [|33l , which says that 
if supply increases and demand remains unchanged, then it leads to lower equilibrium price and 
higher quantity. 

Figure 0] compares the network sum-rate and fairness of the proposed KSBS-based power 
allocation with those of the sum-rate-optimal power allocation and the even power allocation. 
We set the relay power price to be the optimal according to Theorem [Q It can be seen that for 
the system sum-rate, the difference between our algorithm and the sum-rate-optimal solutions is 
within 3.5%, while it is within 13% between the sum-rate-optimal and the even power solutions. 
The proposed solution is about 5 dB superior to the even power allocation. To quantify the 
fairness of different allocation schemes, we use the average value of the normalized difference: 
[maxj(rj) — min^rj)]/ maxj(rj), where r, is the achievable rate of User i. A smaller difference 
indicates a fairer solution. We can see that our solution achieves similar fairness to the even 
power solution and is fairer than the sum-rate-optimal one. 

Next, we examine the trend of the optimal relay price with an increasing demand. From 
Lemma [2l P/(A) is a non-decreasing function of \fi\ 2 . So, we can use an increasing \ fi\ 2 to 
simulate the increasing user demand. In this numerical experiment, we again consider a three- 
user network and model all channels as independent circularly symmetric complex Gaussian 
random variables with zero-mean, that is, they are independent Rayleigh flat-fading channels. 
The variances of all g^s and hi's are 1, while the variance of all / f 's ranges from 1 to 20. A 
larger variance means a higher average value of \fi\ 2 , which on average means a higher power 
demand from the users. The transmit power of the users is set to be 10 dB and relay power is 
set to be 20 dB. Figure [5] shows the optimal relay power price, the actual relay power sold, and 
the maximum relay revenue with different variances of /j. We can see that as the variance of 
increases, the optimal relay price increases, more relay power is sold, and the maximum relay 
revenue increases. This fits one of the laws of supply and demand, which says, if the supply is 
unchanged and demand increases, it leads to higher equilibrium price and quantity. 

In the third numerical experiment, we examine the relationship between the optimal relay 
price and the number of users. We assume that the relay power is fixed to be 20 dB. The user 
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Fig. 4. System sum-rate and fairness of a three-user relay network with Rayleigh-fading channels. 



power is fixed as 10 dB but the number of users vary from 5 to 15. All channels are generated 
following the distribution CjV(0, 1). Figure [6] shows the optimal relay power price, the total 
relay power sold, and the maximum relay revenue with different numbers of users. We can see 
that as the number of users increases, the optimal relay power price increases, the relay power 
actually sold increases, and the maximum relay revenue increases. Figure |6] verifies the same 
law as Figure [H which says, if the supply is unchanged and demand increases, it leads to higher 
equilibrium price and quantity. 

B. Static Network with Path-Loss Channel Only 

In this subsection, we study a static network whose channels are deterministic instead of 
random. The network has three users, one relay, and three destinations. The relative positions of 
the nodes are shown in Figure U\ where the coordinates of User 1-3, the relay, and Destination 
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Variance of fi 



Fig. 5. Three-user relay network with Rayleigh fading channels and different variances of fi. 



1-3 are (-15, 3), (-10, 0), (-5, -3), (0, 0), and (5, 3), (5, 0), (5, -3), respectively. We consider 
the path-loss effect of wireless channels only by assuming that the channel gains are inverse 
proportional to the distance squared. In Figure 7, User 1 is the farthest from its destination and 
thus has the worst channel; while User 3 is the closest to its destination and has the best channel. 
The power of the users is set to be 10 dB and the power of the relay is set to be 15 dB. 

In Figure [H the total power sold to the three users, the relay revenue, and the network sum- 
rate are shown as the relay power price varies. Three power allocation solutions are presented: 
the proposed KSBS-based power allocation, the sum-rate-optimal power allocation, and the 
even power allocation. Note that the sum-rate-optimal allocation solution aims to maximize 
the network sum-rate, is independent of the relay power price, and allocates all the relay power 
P to the three users. We can observe from Figure [8] that, when the price is higher, with the 
KSBS-based and the even power allocation schemes, the users purchase less power from the 
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Fig. 6. Three-user relay network with Rayleigh fading channels and different numbers of users. 
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Fig. 7. A three-user static network. 



relay and the total power demand is smaller. For example, using the KSBS-based allocation 
scheme, the total power demand is less than P when the price is higher than 0.0023. Now let 
us look at different price ranges separately. First, we can see that in the price range [0, 0.0007], 
both KSBS-based and the even power allocation schemes sell all relay power to the users. This 
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Fig. 8. Power allocation, relay revenue, and sum-rate in three-user relay network with static channels. 



is because in this price range, P/(A) > P/3 for % — 1, 2, 3, thus with the even power allocation, 
each user will buy P/3, and all relay power will be sold; for the KSBS-based power allocation, 
Y^=i -P/(A) > P, so all power of the relay will be purchased by the users based on Lemma |4] 
Second, when A > 0.0047, the even power and the KSBS-based schemes give the same power 
allocation results. This is because in this price range, all three users' ideal power demands are 
no more than P/3, that is, P/(A) < P/3 for i = 1, 2, 3 and Y? i= i P I( X ) ^ P - In this scenario, 
from Lemma HI both the even power allocation and the KSBS-based schemes assign the ideal 
power demand P/(A) to User i, and the two schemes have the same performance. And when 
A is in the range [0.0007, 0.0047], the KSBS-based power allocation demands more relay power 
than the even power allocation, and thus the relay receives a higher revenue in this range. This 
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TABLE I 

Achievable rates, normalized rate-difference, and the system sum-rate in three user relay network 

with static channels 





Sum-rate 
-optimal 





0.0013 


0.0027 


0.0047 


0.0053 


Even 


KSBS 


Even 


KSBS 


Even 


KSBS 


Even 


KSBS 


Even 


KSBS 


n 


0.0356 


0.0498 


0.0499 


0.0356 


0.0356 


0.0356 


0.0356 


0.0356 


0.0356 


0.0356 


0.0356 


ri 


0.0838 


0.1017 


0.0994 


0.1017 


0.0991 


0.0823 


0.0823 


0.0627 


0.0627 


0.0627 


0.0627 


rz 


0.2802 


0.2127 


0.2169 


0.2127 


0.2643 


0.2127 


0.2727 


0.1992 


0.1992 


0.1777 


0.1777 


Rate-difference 


0.8729 


0.7658 


0.7701 


0.8325 


0.8652 


0.8325 


0.8694 


0.8211 


0.8211 


0.7995 


0.7995 


Sum-rate 


0.3997 


0.3641 


0.3662 


0.3500 


0.3989 


0.3306 


0.3907 


0.2975 


0.2975 


0.2760 


0.2760 



is because with the even power allocation, a user cannot request more than 1/3 of the total 
relay power, while the KSBS-based scheme does not have this constraint and thus enables users 
to request more power. Furthermore, when A is 0.0027 and the KSBS-based scheme demands 
91% of the relay power to be sold to the users, the relay revenue is maximized. At this relay 
power price, the network sum-rate difference between the proposed KSBS-based solution and 
the sum-rate-optimal power allocation is only about 2%. The sum-rate difference between the 
even power and the sum-rate-optimal schemes, however, is 23% at the price A = 0.0047, which 
is the relay revenue maximizing price under the even power allocation. For any relay price, the 
sum-rate difference between the even power and the sum-rate-optimal schemes is no less than 
9%. 

To further compare the performance of the three schemes, Table H shows each user's achievable 
rate, the normalized rate-difference, and the network sum-rate with the three power allocation 
schemes at the relay power prices 0, 0.0013, 0.0027, 0.0047 and 0.0053. Recall that a smaller 
normalized rate-difference represents a fairer power allocation. As can be seen from Table HI the 
proposed KSBS-based scheme achieves a smaller normalized rate difference than the sum-rate- 
optimal solution for all relay prices, while the network sum-rate difference between these two 
schemes is small. It shows that the proposed solution is fairer than the sum-rate-optimal solution 
with comparable network sum-rate. In sum, Figure [8] and Table U show that for the simulated 
network, the proposed KSBS-based power allocation and relay pricing solutions achieve close-to- 
optimal sum-rate, in the mean while, they also maximize the relay revenue and achieve fairness 
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Relay power constraint P (dB) 



Fig. 9. Sum-rate and relay power price in three user relay network with static channels. 



among users. 

To compare the sum-rates of the proposed solutions and the sum-rate-optimal solution, we 
show in Figure |9] the network sum-rate of the proposed relay pricing and power allocation 
solutions as the relay power constraint P varies. We can see that when the relay power constraint 
P is small, indicating high demand and low supply, the sum-rate of the proposed solution 
is almost the same as the optimal sum-rate of the network. As the relay power constraint P 
increases, indicating low demand and high supply, the sum-rate difference between the proposed 
solutions and the sum-rate-optimal solution increases. When the relay power is 25 dB, the 
difference is about 6%. The optimal relay price, on the other hand, decreases as P increases. 
These verifies the same law of supply and demand with Figure [31 which says, if supply increases 
and demand remains unchanged, then it leads to lower equilibrium price. 
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VII. Conclusion 

In this paper, we study the relay power allocation problem in a multi-user single-relay network. 
By introducing a relay power price, we take into consideration the incentives for cooperation at 
the relay in helping the users. The Stackelberg game is used to model the interaction between 
the relay and the users, in which the relay acts as the leader who sets the price of its power 
to gain the maximum revenue and the users act as followers who pay for the relay service. 
To model the competition among users, a bargaining game and its KSBS are used for a fair 
power allocation. We analytically solve the optimal relay price, while the problem of relay power 
allocation among users is transformed into a convex optimization problem and can be solved 
with efficient numerical methods. Simulation results show that our solutions reflect the laws of 
supply and demand, give better user utilities and relay revenue than even power allocation, and 
approach the sum-rate-optimal power allocation in terms of network sum-rate for a wide range 
of network scenarios. 
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